Infrastructure construction digital integrated twin (icdit)

ABSTRACT

The present disclosure describes a computer-implemented method to manage an industrial plant facility, the method including: monitoring multiple streams of input data from a network of sensors at the industrial plant facility, wherein the network of sensors include one or more camera devices; determining, by a server computer, an event during construction or operation of the industrial plant facility based on analyzing the multiple streams of input data in real-time; and based on the determined event, generating a notification to alert at least one operator of the industrial plant facility.

TECHNICAL FIELD

This disclosure generally relates to infrastructure construction andmanagement.

BACKGROUND

Infrastructure construction and management may be based on progressingdata from independent systems with massive data entries.

SUMMARY

In one aspect, the present disclosure describes a computer-implementedmethod to manage an industrial plant facility, the method including:monitoring multiple streams of input data from a network of sensors(both physical and soft sensing) at the industrial plant facility,wherein the network of sensors include one or more camera devices;determining, by a server computer, an event during construction oroperation of the industrial plant facility based on analyzing themultiple streams of input data in real-time, wherein said analyzingcomprises image processing of a stream of images from the one or morecamera devices; and based on the determined event, generating anotification to alert at least one operator of the industrial plantfacility.

Implementations may include one or more of the following features.

Determining the event of the industrial plant facility may include:determining an emergency occurring inside the industrial plant facilityand in proximity to the at least one operator of the industrial plantfacility. Generating a notification may include: sending an alert to awearable device worn by the at least one operator to notify theemergency. The operations may further include: calculating an escaperoute to guide the at least one operator to safety based on, at least inpart, where the emergency is occurring. The operations may furtherinclude: providing the escape route to the wearable device worn by theat least one operator. The operations may further include: updating theescape route when the at least one operator has started to escape fromthe emergency. Monitoring multiple streams of input data from a networkof sensors may include: accessing streams of data from at least one of:an aerial scanning at the industrial plant facility, a mobile scanningat the industrial plant facility, and a floor scanning at the industrialplant facility, wherein the aerial scanning comprises operating at leastone surveillance drone to monitor the industrial plant facility, whereinthe mobile scanning comprises: operating at least one moveable sensor tomonitor the industrial plant facility, wherein the floor scanningcomprises: operating at least one fixed sensor to monitor the industrialplant facility, and wherein at least one of the one or more surveillancedrones, the one or more moveable sensors, or the one or more fixedsensors comprise: the one or more camera devices.

In another aspect, the present disclosure describes a computer systemcomprising a network of sensors comprising one or more camera devices; aprocessor; and at least one memory, wherein at least one memory comprisesoftware instructions that, when executed by the processor, causes theprocessor to perform operations to manage an industrial plant facility,the operations including: monitoring multiple streams of input data froma network of sensors at the industrial plant facility; determining anevent during construction or operation of the industrial plant facilityand its workforce based on analyzing the multiple streams of input datain real-time; and based on the determined status, generating anotification to alert at least one operator of the industrial plantfacility.

Implementations may include one or more of the following features.

Determining the event of the industrial plant facility may include:determining an emergency occurring inside the industrial plant facilityand in proximity to the at least one operator of the industrial plantfacility. Generating a notification may include: sending an alert to awearable device worn by the at least one operator to notify theemergency. The operations may further include: calculating an escaperoute to guide the at least one operator to safety based on, at least inpart, where the emergency is occurring. The operations may furtherinclude: providing the escape route to the wearable device worn by theat least one operator. The operations may further include: updating theescape route when the at least one operator has started to escape fromthe emergency. Monitoring multiple streams of input data from a networkof sensors may include: accessing streams of data from at least one of:an aerial scanning at the industrial plant facility, a mobile scanningat the industrial plant facility, and a floor scanning at the industrialplant facility, wherein the aerial scanning comprises operating at leastone surveillance drone to monitor the industrial plant facility, whereinthe mobile scanning comprises: operating at least one moveable sensor tomonitor the industrial plant facility, wherein the floor scanningcomprises: operating at least one fixed sensor to monitor the industrialplant facility, and wherein at least one of the one or more surveillancedrones, the one or more moveable sensors, or the one or more fixedsensors include: the one or more camera devices.

In yet another aspect, the present disclosure describes a non-volatilecomputer readable medium comprising software instructions, which, whenexecuted by a computer processor, cause the computer processor toperform operations to manage an industrial plant facility, theoperations including: monitoring multiple streams of input data from anetwork of sensors at the industrial plant facility, wherein the networkof sensors include one or more camera devices; determining an eventduring construction or operation of the industrial plant facility basedon analyzing the multiple streams of input data in real-time; and basedon the determined event, generating a notification to alert at least oneoperator of the industrial plant facility.

Determining the event of the industrial plant facility may include:determining an emergency occurring inside the industrial plant facilityand in proximity to the at least one operator of the industrial plantfacility. Generating a notification may include: sending an alert to awearable device worn by the at least one operator to notify theemergency. The operations may further include: calculating an escaperoute to guide the at least one operator to safety based on, at least inpart, where the emergency is occurring. The operations may furtherinclude: providing the escape route to the wearable device worn by theat least one operator. The operations may further include: updating theescape route when the at least one operator has started to escape fromthe emergency. Monitoring multiple streams of input data from a networkof sensors may include: accessing streams of data from at least one of:an aerial scanning at the industrial plant facility, a mobile scanningat the industrial plant facility, and a floor scanning at the industrialplant facility, wherein the aerial scanning comprises operating at leastone surveillance drone to monitor the industrial plant facility, whereinthe mobile scanning comprises: operating at least one moveable sensor tomonitor the industrial plant facility, wherein the floor scanningcomprises: operating at least one fixed sensor to monitor the industrialplant facility, and wherein at least one of the one or more surveillancedrones, the one or more moveable sensors, or the one or more fixedsensors comprise: the one or more camera devices.

Implementations according to the present disclosure may be realized incomputer implemented methods, hardware computing systems, and tangiblecomputer readable media. For example, a system of one or more computerscan be configured to perform particular actions by virtue of havingsoftware, firmware, hardware, or a combination of them installed on thesystem that in operation causes or cause the system to perform theactions. One or more computer programs can be configured to performparticular actions by virtue of including instructions that, whenexecuted by data processing apparatus, cause the apparatus to performthe actions.

The details of one or more implementations of the subject matter of thisspecification are set forth in the description, the claims, and theaccompanying drawings. Other features, aspects, and advantages of thesubject matter will become apparent from the description, the claims,and the accompanying drawings.

DESCRIPTION OF DRAWINGS

FIGS. 1A to 1C illustrate examples of various aspects of anInfrastructure Construction Digital Integrated Twin (ICDigIT) accordingto an implementation of the present disclosure.

FIGS. 2A to 2C illustrate examples of a Wireless; Wireless ISA,Long-Range Wide Area Network (LoRaWAN), and or 5^(th) GenerationWireless network architecture according to implementations of thepresent disclosure.

FIGS. 3A to 3B illustrates examples of an intelligent wearable deviceaccording to some implementation of the present disclosure.

FIG. 3C illustrates an example of a flow chart according to animplementation of the present disclosure.

FIGS. 4A-4E illustrate examples of handling an emergency in anindustrial plant facility according to an implementation of the presentdisclosure.

FIG. 5 illustrates an example of a flow chart according to animplementation of the present disclosure.

FIG. 6 is a block diagram illustrating an example of a computer systemused to provide computational functionalities associated with describedalgorithms, methods, functions, processes, flows, and procedures,according to an implementation of the present disclosure.

Like reference numbers and designations in the various drawings indicatelike elements.

DETAILED DESCRIPTION

The disclosed technology is directed to infrastructure construction andmanagement. The current industry practice in infrastructure constructionand buildout progressing and quality integrity is based on manualprocessing supported by independent systems with massive data entries.Moreover, the current practice lacks an integrated systems that cancapture the whole process of construction from design, supplies,construction asset, construction tools, material, workforce, and qualitycontrols. In contrast, the present disclosure introduce an end-to-endoperating model for an integrated digital twin, InfrastructureConstruction Digital Integrated Twin (ICDigIT), the serves to bridge theconstruction and operation of an industrial facility. For example, theICDIT encompasses the complete cycle of the facility construction andoperation, including, Engineering Design and Simulation, Procurement andLogistics, Construction and Handover, and Operation and maintenance. Thesupply chain management attribute across these four main segments isincluded.

The Infrastructure Construction Digital Integrated Twin (ICDIT) is basedon interaction and interplay between exemplary components in designingand construction of a plant facility. These components encompass variousaspects of data sensing, collection, exchange, and computing. In one usecase example, implementations of ICDIT can track asset build/assemblyduring construction. Here, real-time information such as imagery fromthe construction site, data from traffic scanning of asset movements,data from sensor networks at the construction site may be leveraged todetermine construction progress, inventory tracking, etc. In another usecase example, a controller provides route mapping and localizationservices throughout the plant for which guided escape routes maybeimprovised in hazardous events such as gas leaks or fire outbreaks. Inother words, during an emergency, a wearable device on a crew member maybe equipped with real-time location and situation awareness informationto navigate the crew member through the thick of the emergency tosafety.

FIGS. 1A to 1C illustrate examples of various aspects of anInfrastructure Construction Digital Integrated Twin (ICDIT). Asillustrated by diagram 100, the ICDIT encompasses complete cycles of thefacility construction and operation, including construction projects 102running the project digital twin 103F and operation facility 104 runningthe operations digital twin 103G. The project digital twin may includeengineering design and simulation module 103A, procurement and logisticsmodule 103B, and construction and handover module 103C. The operationsdigital twin 103G may include operations and maintenance module 103D.The supply chain management module 103E may extend over both twins.

The ICDIT 100 is based on interaction/interplay between the componentsin designing and construction of plant facility, which, as illustratedby diagram 110, can include superimposed multidimensional dataacquisitions, processing, correlation, and visualization. Themultidimensional aspects can include 3D, 4D (time), 5D (Cost), 6D(Efficiency), up to 7D (Operate & Maintain). These components, asoutlined below, together form the digital twin for the facilityconstruction. The visualization Hub 112 interacts with processsimulation module 111A, electric instrument module 111B. structurestability analysis module 111C, material take-off 111D, scheduling andquality 111E, process and instrumentation design PFD 111F, mechanicaldesign module 111G, piping module 111H, equipment sizing module 111I,cost estimation module 111J, construction sequence module 111K. Asillustrated, the visualization hub 112 engages data management 113A,drawing generation 113B, clash detection/standards attributes 113C, andconstruction management 113D. The visualization hub 112 further engagesdesign review 114A, RFT/ID process 114B, hand over document 114C, andhandshake processes 114D.

The ICDIT 100 incorporates data sensing, collection, exchange, andcomputing over high speed network exemplified by local network trafficconcentrator LNTC 123, as illustrated by diagram 120 of FIG. 1C. In moredetail, The ICDIT 100 is based on interaction, interplay of hierarchicalbuilding blocks including work flow generator interface system (WGIS)121A, real time visualization progression RTVP 121B, constructionproject safety monitoring system (CPSMS) 121C, central time distributedsystem (CTDS) 121D, central network traffic concentrator (CNTC) 122A,safety and quality monitoring system (SQMS) 122B. Through high speednetwork managed by local network traffic concentrator (LNTC) 123,multipurpose sensor network (MSN) 124A, people based sensor (PBS) 124B,traffic scanner system (TSS) 124C, event based autonomous sensors (ERAS)124D, fixed asset based sensor (FABS) 124E, dynamic asset based sensor(DABS) 124F, and mobile asset sensor (MAS) 124G jointly provide locationand situation awareness for multidimensional visualization including 3D,4D (time), 5D (Cost), 6D (Efficiency), up to 7D (Operate & Maintain).

The local network traffic concentrator (LNTC) 123 can connect to wiredand wireless field devices and networks. The LNTC 123 includes computingand data storage capability. The LNTC can process all collected data andproduce reporting and new database that can be used by other 3^(rd)party applications for Artificial Intelligence (AI) and Machine learningapplication. The LNTC 123 includes software interface capabilities(Application Programming Interface or API) to connect with otherdatabases locally or in wide area network. The LNTC 123 can translatecaptured images for the dynamic asset and establish mapping to thefacility build out plan, timelines, asset inventory, and produce apredictive model on anticipated progress, asset consumption. In somecases, the LNTC 123 can capture all the data from the operator withinthe facility, can capture data from mobile, can translate capturedimages for the dynamic asset and detect metrological hazards and/orunsafe conditions, can capture all the data from EBAS 124D, and cancommunicate commands to SQMS 122B.

In comparison, the CTDS 122A is based on fault tolerant network timeprotocol (NTP) clock synchronization with a direct GPS feed. The CTDS122A has internetworking capability to interface all the field devices.The CTDS 122A can synchronize all field devices with the same time stamppoint.

The workflow generator interface system (WGIS) 121A can develop, add,delete, and modify workflows for asset use and resource management. Forexample, the interface workflow may merge seamlessly with communicationsystems such as email, wired phone, mobile phone, and otherweb-interface communication systems.

The real time visualization progression (RTVP) 121B can displayreal-time build out activities program. For example, the RTVP 121B maysuperimpose build out 3D image with the real-time progress teed. TheRTVP 121B may provide dashboard and reporting capabilities on bothconstruction progress and safety behavior metrics. The RTVP 121B mayhave the capability to detect schedule and geometric mismatch betweenthe real-time captured 3D module and the 3D planned design. The RTVP121B may include software interface capabilities (ApplicationProgramming Interface, e.g., API) to connect with other databaseslocally or in wide area network. The RTVP 121B may have the capabilityto communicate with DABS 124F and/or EBAS 124D to request cameramovement and robot/drone dispatch.

The safety and quality monitoring system (SQMS) 122B can be embodied asa construction project quality monitoring system (CPQMS) and aconstruction project safety monitoring system (CPSMS). In case of theCPQMS, SQMS 122B can project construction progress visualization throughthe creation of 3D models from videos and imagery taken either by groundCCTV systems or aerial photogrammetry such as from drones. The data fromthe 3D models are correlated with asset construction progress fromresource management. This can include 2D engineering tools, materialsmanagement, project controls, scheduling systems, and video andanalytics systems. The SQMS 122B can provide 3D scanning to capture theconstruction status and verify it against the design basis in the 3Dmodel to ensure that future construction and operation will proceedsmoothly and identify any quality issues as early as possible. The SQMS122B can provide true 3D model from a circular aperture or multiplesingle aperture, with high definition resolution (mm to km), providesactive and passive 3D modeling, and allows identification and taggingfor industrial equipment. The SQMS may utilize the available data from3D models, 2D engineering tools, materials management, project controls,and scheduling systems, to ensure that accurate and timely decisions canbe made on the most updated information needed for optimizedconstruction planning and execution.

In the case of the CPSMS, the SQMS 122B can include monitoring,detection and notification of workers health, unsafe behaviors andunsafe conditions using data from the available work management systemsincluding access control, health monitoring systems, and meteorologicalmonitoring systems. The SQMS 122B involves acquiring, processing andanalysis of CCTV systems video and imagery output. The SQMS providesreal-time notifications when a potential safety violation is occurringthat is related to workers health, unsafe behaviors and unsafeconditions. The SQMS 122B gathers and integrates data from worker healthconditions, meteorological conditions and related site safetyrequirements. The SQMS 122B can includes worker identification by, forexample, providing facial identification (or other biometrics),regulating access authorization to restricted areas, regulating generalaccess authorization whether to allow or deny identified individuals,and creating space safety zones. The SQMS 122B can further monitorworker health conditions including, for example, heat and cold stressconditions, slip and fall incidents, fatigue conditions, man downincidents, overexertion conditions, and fit to drive status, tracklocation, monitor proximity alerts, create time safety limits (e.g.,flagging workers not following minimum resting requirements), and linkrequirements with meteorological conditions. The SQMS 122B canadditionally assist to enforce personal protective equipment (PPE) by,for example, defining PPE safety requirement zones, detecting, safetyshoes, safety vests, safety harness at elevated platforms for instance,eye protection, helmet and hard hat, and ear plugs. The SQMS 122B mayfurther enforce early detection of other workplace surrounding hazardsincluding, for example, falling hazards from elevated platforms orshop-floor surfaces such as slippery surfaces, trip hazards, clutter,leaks, standing water, working at heights, and fall protection gear.Such workplace surrounding hazards may additionally include: electricaloverhead travelling crane, and mobile equipment hazards and electricalhazards. The SQMS 122B may additionally identify when a worker showssigns of fatigue; identify blocked fire exits, spills, andover-stacking/blocked sprinkler heads; identify prohibited usage ofmobile inside process areas; use tagging to track chemicals, and howlong they have been kept, notify when hazardous chemicals are pulledfrom storage; notify and tack how long an employee enters a confinedspace, repetitive motion alert, improper lifting form alert; andidentify unauthorized vehicles accessing prohibited areas.

The multipurpose sensor network (MSN) 124A includes integrated sensorsthat have direct and indirect contact sensing capabilities coveringpeople, fixed asset (such as completed buildings), dynamic asset (suchas drillings), mobile asset (such as vehicles) and autonomous sensors.The MSN 124A may communicate via wire, wirelessly, or both. The MSN 124Ais capable of operating at various temperature and weather conditions(e.g., rainy or dusty weather). The MSN 124A can additionally triggervisual and/or audible notification. In more detail, the sensors can hascomputing and data storage capability in addition to retaining time andlocation. The sensors can also be personalized to an operator or workerspecific setting.

The people based sensor (PBS) 124B may include durable sensor andnon-reusable sensor. An example of a durable sensor can be an equipmentsupported by long last power source, digitally operated with contactsensors that has the ability to be personalized and collect humanessential health signs, location, movement, direction, and posture.Human essential health signs sensor may be based on direct sensorcontact with the human body, hand wrest, chest, and or legs. It can beembedded as part of a wearable uniform and or similar to other personalprotective equipment (Hats, Wearable clothes, and portable withconnection on demand). Location aware sensor has the ability to keeptrack of the location based on, for example, global positioning system(GPS) or radio-frequency identification (RFID) positioning system. Thesesensor generally retain movement and direction and may relay thecollected data. An example of a non-reusable sensor include a sensormade of synthetic material that that can be attached on human to asurface. While such sensors can be discarded, the non-reusable sensorssupport RFID technology and are readable by RFID scanning technology.For example, each may be associated with a unique 2D bar code that canbe scanned by a camera device.

The fixed asset based sensor (FABS) 124E can report on location andtrigger alarms upon unauthorized mobility. The dynamic asset basedsensor (DABS) 124F can be equipped by video/optical sensor network thatkeep tracks of its progression. In some instances, the optical/videosystem will be based on high resolution (60 frame per second). Theoptical/video camera movement can be based on a control loop feed. Thecontrol feed input may be based on detection of a change in constructionor predefined schedule. The optical/video system may be capable ofwide-angle capturing (80 degrees) field of view, super-wide angle of 180degrees or higher.

The mobile asset sensor (MAS) 124G may be equipped with a device tocapture data on speed, engine health status, operating hours, outagetime, parts replacement. The MAS 124G may be networked and locationaware of the current position. In some instances, the MAS 124G has 360sensing capability of other objects within 1 to 15 meters. In theseinstances, the MAS 124G may incorporate a control loop based on feedbackinput from other assets of approaching objects and trigger alarms toprevent direct contact with other objects.

The event based autonomous sensors (EBAS) 124D may be equipped byvideo/optical sensor network mounted on autonomous robotics and/ordrones. In some cases, the optical/video system is based on highresolution (60 frame per second). In these cases, the EBAS movement canbe based on a control loop feed with autonomous maneuver algorithm/AI.The control feed input is based on a request from PBS 124B, FABS 124E,DABS 124F or MAS 124G, predefined schedule or manual dispatch. Theoptical/video system may be capable of wide-angle capturing (80 degrees)field of view, super-wide angle of 180 degrees or higher.

The traffic scanner system (TSS) 124C can scan people, tools, andassets. In some cases, the TSS 124C include scanners that are positionedbased on the build out structure pathways. In these cases, the scannersare connected to alarm and sound system that will be trigged by theobject movements with corresponding sound or message. Each scanner mayinclude local computing and data storage capabilities, can communicatewirelessly or in a wired manner, and can read data via RFID technology.

Implementations described in the present disclosure can provide seamlessintegration with plant automation systems of an industrial plant,enabling it to receive commands and respond to alarms and system alerts.As illustrated in FIG. 2A, an example of a Wireless, Wireless ISA,Long-Range Wide Area Network (LoRaWAN), and or 5^(th) GenerationWireless network architecture 200 can include wireless field instruments202 (further including instruments 202A, 202B, 202C, 202D, 202E, 202F,202G, and 202H that form a RF mesh network 203), and a Wireless gateway204 on a plant control network 205 (e.g., through interface 205A thatincludes Ethernet). The plant control network 205 may operate a DCS(distributed control system) that emphasizes process-level operations,or a SCADA (supervisory control and data acquisition) that isevent-driven and prioritizes data gathering (206). For example, A DCSdelivers data to operators, and at the same time, a SCADA concentrateson the acquisition of that data. The Wireless gateway 204 may operate agateway security manager 204A. The Wireless gateway 204A may includethree main functions, namely, access point, radio, and manager, in onebox serving only one particular area in the plant. As described in thepresent disclosure, the Wireless network is re-architected so that the“Radio” and “access point” are detached from the controller and managingsoftware. The access point are distributed throughout the plant and areconnected back to “one” controller serving the entire plant facility.The central controller does not only provide wireless connectivitymanagement but also provided wireless power to access point. The processcontrol instrumentation module includes a unified Wireless gatewayfunction embedded in a central controller that interconnects and managesthe field receptors.

Further referring to diagram 210 from FIG. 2B, the Wireless radioreceptors (212A, 212B, 212C, 212D, 212E, 212F, 212G, and 212H) connectthe remote field devices utilizing the 2.4 GHZ frequency band. Thereceptors are connected via physical medium back to the centralcontroller 213A where the unified Wireless gateway is performed. Thecentral controller 213A may include power supply 213B, managementoptimization and route mappings 213C, and PCS&DM (Process Control Systemand Data Monitoring) integration 213D. The Wireless gateway thus acts asa unified medium between the Wireless connected devices and the plantnetwork using standard protocols such as Modbus or Profibus.

In some case, the controller comprises a unified Wireless gatewayfunction interconnecting distributed wireless field transceiver using802.111.b/g/n/ac WLAN and converts the HART data to Modbus TCP for easyintegration with the plant's control systems. The integration withplant's control systems can be made via an Ethernet port or theintegrated controller through which it also connects the various WLANclient transceiver. The data collected from the field Wirelesstransceivers converted into Modbus TCP before transporting them on theplant's control systems. The controller is configurable and manageablevia an embedded secure terminal connection for which detailed systemdiagnostics can also be made available. The field wireless transceiveris capable of connecting up to, for example, 250 Wireless field deviceswith the capability of an RF Link relay indication and the ability tomeasure the strength of the WLAN signal as an analog voltage. The fielddevices are automatically (dynamic assignment) assigned a Modbus ID toenable it to communicate with the master controller.

FIG. 2C shows an example of a Wireless gateway 220 to illustrate theunified Wireless controller components according to someimplementations. The Wireless gateway 220 includes CPU (centralprocessing unit) 221A, memory 221B, SSD (solid state storage device)221C, management software 221D (which may include firmware), GPS/WiFilocalization module 221E, OLE (object linking and embedding) for processcontrol (OPC) 221F, remote diagnosis library 221G, Wireless HART, ISA,Long-Range Wide Area Network (LoRaWAN), and or 5th Generation Wirelesscontroller 221H, SCADA/DCS interface 221I, plant network interface 221J,pattern recognition 221K, security module 221L, windsock input 221M, inaddition to Modbus, RJ45, RS485, and OPC interface connectors. Here,windsocks are used to provide indication of wind speed and direction inanalogue or digital representation. Windsocks may be used atpetrochemical plant facilities where s risk of gaseous leakage or fireexist. In some windsock implementations, wind speed is indicated by thewindsock's angle relative to the mounting pole; in low winds, thewindsock droops; in high winds it flies horizontally. The speed of windis estimated by highly visible orange and white stripes with each stripeadds up 3 knots to the estimated wind speed. For the present disclosure,a digital or analogue output windsock will be used to provide generalwind speed and direction which will be used by the emergency routeescape mapping procedures to determine the most accessible and safe exitfor workers should an emergency occur.

Intelligence Instrumentation will provide the hat (helmet) withhardware/software based technical abilities to perform intelligentfunctions such as localization and guidance, expanded diagnostics basedon pattern recognition and image analysis. Referring to FIG. 3A, anexample of a helmet 300A can include a side-mounted intelligent device301A while another example of a helmet 300B can include a side-mountedintelligence device 301B. The mounting location can be slightly abovethe ear location. As illustrated in FIG. 3B, an example of an assembly310 can include a transceiver module 311 that includes antenna 311A andelectronics 311B, a connector belt 312, and a terminal 313 that includestouch pad 313A with tactile control. In this example, the transceivermodule 311 can be mounted on the outside of the helmet while theterminal 313 can be mounted on the inside of the helmet, for example,closer to the eye. The terminal 313 may also include projector-type ofdisplay to be mounted on, for example, towards the forehead region toproject a visual display to the operator wearing the helmet. In somecases, the apparatus can support a helmet attached an ultrasound mobileemitter that can be used to scan the outer surface of pipes forpotential corrosion or deformation. In these case, a portablehydrophones can be used to complement the function of the ultrasoundemitter from the helmet. In some cases, the apparatus is able to readequipment tag and fetch information related to inventory, for example,supply and spare parts availability/compatibility.

FIG. 3C illustrates an example of a flow chart 320. The process starts(321) and a smart helmet (or hat) receives a safety incident alarm(322). In response, the PCT identified the area of the plant affected bythe incident (323). In other words, the location of the incidentdetermines whether the incident is in an area of hazard (324). If thedetermination is that the incident is not in a hazardous area, theprocess may proceed to acknowledge the alarm only (326). If thedetermination is that the incident is in a hazardous area, the processmay proceed to acknowledge the alarm and second a position tag to asafety coordinator (325A), perform route calculation and map multipleexit routes (325B), and then starts navigation to guide the operator tosafety (325C). The process may receive updated location from theoperator's helmet and determine, in real time the whereabouts of theoperator. Based on the location of the operator, the process maydetermine whether the operator is in a designated safe area (326). Ifthe determination is yes, the process may transmit a success flag toalert manager 328 (327A). Otherwise, the process may transmit a failflag to alert manager 328 (327B). The alert manager 328 may furthercommunicate with the smart helmet.

In some implementations, the plant floor is divided into a number ofcells or areas of coverage to facilitate adequate wireless connectivityand reliable integration to the process control systems. The areas aredefined as part of a matrix with rows and columns so that each cell isaddressable by its row and column identifier. As illustrated in FIG. 4A,an example of a plant floor 400 is divided 16 sixteen cells, in rows 1to 4 and columns a to d. In this example, a receptor, which can operateon the Wireless protocol, is installed in each coverage area whereby thesignal quality and propagation is ensured. The receptors are distributedthroughout the plant floor and are connected to a central managementcontroller for the whole plant facility. Further referring to FIGS. 4Bto 4C, the placement of the receptors, as illustrated by plans 410 and420, provide coverage for each area marked in hexagonal region, fromarea 1 (and sub-regions a to d), area 2 (from sub-regions a to d), area3 (from sub-regions a to d), and area 4 (from sub-regions a to d). Thehexagonal cells are grouped into respective areas, each can have its ownconnectivity or security profile.

Moreover, Audio Visual Alerting Systems (AVAS) is included in each areaor region. The AVAS includes signal initiation, transmission,notification, and annunciation in the area designed and installed tomeet the levels of performance. The AVAS components (loud speaker andalerting light) are used to complement the wireless Personal ProtectedEquipment and or Mobile Device communication. The AVAS stations areinstalled at least 1.5 Meter from the work area ground level of eachArea or one or more Area to enable Operator to have a visual and canhear audio. AVAS provides visual alerting and visual systems such aschanging color coding: Green=safe; Red=is danger; and flashing amberimplies work is in progress). The AVAS Light and Audio stations whichconsist of amplifiers, junction enclosures, plugs and loudspeakersinstalled in Area are to be in compliance to area classification(industrial requirements Hazardous and standard building Management).AVAS will imply acoustic safety components in areas where ambient noiselevels exceed 80 dBA. The AVAS include a multi-tone generator capable ofgenerating different types of tones for different emergency conditions,such as; yelp, warble, siren, and steady tone.

The controller performs management and administration functions such assecurity management and controls including authentication and trafficoptimization process for connected field devices. The controller alsoprovides route mapping and localization services throughout the plantfor which guided escape routes maybe improvised in hazardous events suchas gas leaks or fire outbreaks. The controller is connected to all plantdistributed receptors via physical mediums such as copper or fiber opticcabling to eliminate or minimize interference and provide robust andreliable system interconnectivity.

FIG. 4D illustrates a use case 430 of intelligent guidance for escaperoutes during emergency. As illustrated, a fire breaks out due to gasleak in an area close to the northern exit. An operator, for example, anemployee operating on-site is notified of the emergency right away.Here, the controller may calculate an escape route based on real-timeinformation from the various sensors at the plant. In this illustration,the computed escape is from area 3.a to area 3.b, then to area 2.b andto area 2d, and finally to area 2.d. The escape route can be computed tooptimize the fastest route to a safety area, or the fastest time to anexit. In some cases, route computation is based on a static escape routeplan which is defined as a result of the risk assessment (e.g., what ifscenarios). Based on a risk event location, the route is displayed tothe individual communication media (e.g., tablet, radio, phone that maybe mounted on the individual's helmet) and the individual select thenearest route.

In some cases, the route can be computed based on captured sensor data(gas leak or fire) that is mapped to the facility floor plan. Bysuperimposing the GPS location of the individual to the sensor data, anescape routed is identified and communicated to the person communicationmedia (e.g., tablet, radio, phone that may be mounted on theindividual's helmet) and the individual select the nearest route. As theindividual progresses along the way, the routing information may beupdated, for example, when the individual misses a turn, a better routeemerges, or a new emergency occurs.

In various implementations, the escape route may be based on analgorithm with streams of input from multiple sensors. The sensor inputcan originate from body held sensing that could provide informationabout individual wearing the PPE (personal protective equipment) such asbody temperature, heartbeat, perspiration rate etc. The sensor input canalso come from plant instrumentation and control systems such as gas orchemical leaks, pressure spikes etc. The sensor input can also come fromenvironmental such as wind speed and direction. The combined informationis then augmented by localization information obtained from SSID(service set identifier) association throughout the plant for the mostlogical (e.g., fastest or closest) exit route that will insure thesafety of the worker. Generally, it is preselected based on riskevaluation (e.g., in what if risk scenarios) or based on real-timesensor data correlation to the individual location, or a combination ofboth thus giving the individual the choice to select the suitable escaperoute.

Further referring to diagram 440 from FIG. 4E, an edge analyticsplatform 400 is provided to generate real-time routing information.Platform 400 includes network switch 441 providing connectivity to CCTVcamera sensors 446, VMS (Video Management System) 442, analytics server443, monitoring terminal 444, as well as user tablet 445. In thisexample, CCTV camera sensors monitor a plant facility to provide realtime video streaming. Edge analytics can be derived based on the streaminput using a stand-alone computing server 443 or utilizing VMS 442. Theedge data analytics is correlated to key performance indicators (KPI)dashboard (e.g., user tablet 445) to achieve accurate workeridentification and tracking, zero worker violations, and zero unsafecondition. The KPIs are achieved with high accuracy with no falsenegatives/positives which may introduce unreliability of the analytics.The edge detection capabilities are based on mapping the individual PPEprofile to the actual facility area (zone or segment). The solutionprovides real-time notifications when a potential safety violation isoccurring that is related to workers health, unsafe behaviors and unsafeconditions. The solution is capable of gathering and integrating datafrom worker health conditions, meteorological conditions and relatedsite safety requirements, as outlined above with respect to FIGS. 1A to1C.

FIG. 5 is a flow chart 500 illustrating an example of intelligent edgeanalytics based on some implementations. Multiple streams of sensorinput can be collected at CCTV feed (504). These streams of input caninclude aerial scanning (501), mobile scanning (502), and fixed floorscanning (503). Here, the use of drone will provide aerial imaging(scanning) based on scheduled and unscheduled aerial trips. Based on theimage feed from cameras and edge platform, video analytics can begenerated (505). The video analytics are evaluated to determine a safetystatus (506) of the plant operation (507). If a safety violation isdetected, a notification is generated (509) and the log file is updated(510). If no safety violation is detected, the process may continue withcollecting and analyzing video feed (508). Based on the image feed fromcameras and edge platform, 3D models of the constructed objects can bebuilt (511). From this 3D model, a comparison can be made between theactual construction and the planned construction (518). Based on thecomparison, a schedule (519) can be inspected to determine whetherschedule variations exist (520). If no variations are detected, theprocess may continue with collecting and analyzing the video feed (521).If variations are detected, notifications are generated (522) and a logfile is updated (523). From this 3D model, a comparison can be madebetween the actual construction and the designed project (512). Qualitymetrics can be inspected to determine whether there are qualityviolations (514). If no quality violations are detected, the process maycontinue with collecting and analyzing video feed (515). If qualityviolations are detected, a notification is generated (516) and the logfile may be updated (517).

FIG. 6 is a block diagram illustrating an example of a computer system600 used to provide computational functionalities associated withdescribed algorithms, methods, functions, processes, flows, andprocedures, according to an implementation of the present disclosure.The illustrated computer 602 is intended to encompass any computingdevice such as a server, desktop computer, laptop/notebook computer,wireless data port, smart phone, personal data assistant (PDA), tabletcomputing device, one or more processors within these devices, anothercomputing device, or a combination of computing devices, includingphysical or virtual instances of the computing device, or a combinationof physical or virtual instances of the computing device. Additionally,the computer 602 can comprise a computer that includes an input device,such as a keypad, keyboard, touch screen, another input device, or acombination of input devices that can accept user information, and anoutput device that conveys information associated with the operation ofthe computer 602, including digital data, visual, audio, another type ofinformation, or a combination of types of information, on agraphical-type user interface (UI) (or GUI) or other UI.

The computer 602 can serve in a role in a computer system as a client,network component, a server, a database or another persistency, anotherrole, or a combination of roles for performing the subject matterdescribed in the present disclosure. The illustrated computer 602 iscommunicably coupled with a network 630. In some implementations, one ormore components of the computer 602 can be configured to operate withinan environment, including cloud-computing-based, local, global, anotherenvironment, or a combination of environments.

The computer 602 is an electronic computing device operable to receive,transmit, process, store, or manage data and information associated withthe described subject matter. According to some implementations, thecomputer 602 can also include or be communicably coupled with a server,including an application server, e-mail server, web server, cachingserver, streaming data server, another server, or a combination ofservers.

The computer 602 can receive requests over network 630 (for example,from a client software application executing on another computer 602)and respond to the received requests by processing the received requestsusing a software application or a combination of software applications.In addition, requests can also be sent to the computer 602 from internalusers, external or third-parties, or other entities, individuals,systems, or computers.

Each of the components of the computer 602 can communicate using asystem bus 603. In some implementations, any or all of the components ofthe computer 602, including hardware, software, or a combination ofhardware and software, can interface over the system bus 603 using anapplication programming interface (API) 612, a service layer 613, or acombination of the API 612 and service layer 613. The API 612 caninclude specifications for routines, data structures, and objectclasses. The API 612 can be either computer-language independent ordependent and refer to a complete interface, a single function, or evena set of APIs. The service layer 613 provides software services to thecomputer 602 or other components (whether illustrated or not) that arecommunicably coupled to the computer 602. The functionality of thecomputer 602 can be accessible for all service consumers using thisservice layer. Software services, such as those provided by the servicelayer 613, provide reusable, defined functionalities through a definedinterface. For example, the interface can be software written in JAVA,C++, another computing language, or a combination of computing languagesproviding data in extensible markup language (XML) format, anotherformat, or a combination of formats. While illustrated as an integratedcomponent of the computer 602, alternative implementations canillustrate the API 612 or the service layer 613 as stand-alonecomponents in relation to other components of the computer 602 or othercomponents (whether illustrated or not) that are communicably coupled tothe computer 602. Moreover, any or all parts of the API 612 or theservice layer 613 can be implemented as a child or a sub-module ofanother software module, enterprise application, or hardware modulewithout departing from the scope of the present disclosure.

The computer 602 includes an interface 604. Although illustrated as asingle interface 604 in FIG. 6, two or more interfaces 604 can be usedaccording to particular needs, desires, or particular implementations ofthe computer 602. The interface 604 is used by the computer 602 forcommunicating with another computing system (whether illustrated or not)that is communicatively linked to the network 630 in a distributedenvironment. Generally, the interface 604 is operable to communicatewith the network 630 and comprises logic encoded in software, hardware,or a combination of software and hardware. More specifically, theinterface 604 can comprise software supporting one or more communicationprotocols associated with communications such that the network 630 orinterface's hardware is operable to communicate physical signals withinand outside of the illustrated computer 602.

The computer 602 includes a processor 605. Although illustrated as asingle processor 605 in FIG. 6, two or more processors can be usedaccording to particular needs, desires, or particular implementations ofthe computer 602. Generally, the processor 605 executes instructions andmanipulates data to perform the operations of the computer 602 and anyalgorithms, methods, functions, processes, flows, and procedures asdescribed in the present disclosure.

The computer 602 also includes a database 606 that can hold data for thecomputer 602, another component communicatively linked to the network630 (whether illustrated or not), or a combination of the computer 602and another component. For example, database 606 can be an in-memory,conventional, or another type of database storing data consistent withthe present disclosure. In some implementations, database 606 can be acombination of two or more different database types (for example, ahybrid in-memory and conventional database) according to particularneeds, desires, or particular implementations of the computer 602 andthe described functionality. Although illustrated as a single database606 in FIG. 6, two or more databases of similar or differing types canbe used according to particular needs, desires, or particularimplementations of the computer 602 and the described functionality.While database 606 is illustrated as an integral component of thecomputer 602, in alternative implementations, database 606 can beexternal to the computer 602. As illustrated, the database 606 holds thepreviously described data 616 including, for example, multiple streamsof data from various sources, such as the aerial scanning, mobilescanning, and fixed floor scanning, as explained in more detail inassociation with FIGS. 1A to 1C and 5.

The computer 602 also includes a memory 607 that can hold data for thecomputer 602, another component or components communicatively linked tothe network 630 (whether illustrated or not), or a combination of thecomputer 602 and another component. Memory 607 can store any dataconsistent with the present disclosure. In some implementations, memory607 can be a combination of two or more different types of memory (forexample, a combination of semiconductor and magnetic storage) accordingto particular needs, desires, or particular implementations of thecomputer 602 and the described functionality. Although illustrated as asingle memory 607 in FIG. 6, two or more memories 607 or similar ordiffering types can be used according to particular needs, desires, orparticular implementations of the computer 602 and the describedfunctionality. While memory 607 is illustrated as an integral componentof the computer 602, in alternative implementations, memory 607 can beexternal to the computer 602.

The application 608 is an algorithmic software engine providingfunctionality according to particular needs, desires, or particularimplementations of the computer 602, particularly with respect tofunctionality described in the present disclosure. For example,application 608 can serve as one or more components, modules, orapplications. Further, although illustrated as a single application 608,the application 608 can be implemented as multiple applications 608 onthe computer 602. In addition, although illustrated as integral to thecomputer 602, in alternative implementations, the application 608 can beexternal to the computer 602.

The computer 602 can also include a power supply 614. The power supply614 can include a rechargeable or non-rechargeable battery that can beconfigured to be either user- or non-user-replaceable. In someimplementations, the power supply 614 can include power-conversion ormanagement circuits (including recharging, standby, or another powermanagement functionality). In some implementations, the power-supply 614can include a power plug to allow the computer 602 to be plugged into awall socket or another power source to, for example, power the computer602 or recharge a rechargeable battery.

There can be any number of computers 602 associated with, or externalto, a computer system containing computer 602, each computer 602communicating over network 630. Further, the term “client,” “user,” orother appropriate terminology can be used interchangeably, asappropriate, without departing from the scope of the present disclosure.Moreover, the present disclosure contemplates that many users can useone computer 602, or that one user can use multiple computers 602.

Implementations of the subject matter and the functional operationsdescribed in this specification can be implemented in digital electroniccircuitry, in tangibly embodied computer software or firmware, incomputer hardware, including the structures disclosed in thisspecification and their structural equivalents, or in combinations ofone or more of them. Software implementations of the described subjectmatter can be implemented as one or more computer programs, that is, oneor more modules of computer program instructions encoded on a tangible,non-transitory, computer-readable computer-storage medium for executionby, or to control the operation of, data processing apparatus.Alternatively, or additionally, the program instructions can be encodedin/on an artificially generated propagated signal, for example, amachine-generated electrical, optical, or electromagnetic signal that isgenerated to encode information for transmission to a receiver apparatusfor execution by a data processing apparatus. The computer-storagemedium can be a machine-readable storage device, a machine-readablestorage substrate, a random or serial access memory device, or acombination of computer-storage mediums. Configuring one or morecomputers means that the one or more computers have installed hardware,firmware, or software (or combinations of hardware, firmware, andsoftware) so that when the software is executed by the one or morecomputers, particular computing operations are performed.

The term “real-time,” “real time,” “realtime,” “real (fast) time (RFT),”“near(ly) real-time (NRT),” “quasi real-time,” or similar terms (asunderstood by one of ordinary skill in the art), means that an actionand a response are temporally proximate such that an individualperceives the action and the response occurring substantiallysimultaneously. For example, the time difference for a response todisplay (or for an initiation of a display) of data following theindividual's action to access the data can be less than 1 millisecond(ms), less than 1 second (s), or less than 5 s. While the requested dataneed not be displayed (or initiated for display) instantaneously, it isdisplayed (or initiated for display) without any intentional delay,taking into account processing limitations of a described computingsystem and time required to, for example, gather, accurately measure,analyze, process, store, or transmit the data.

The terms “data processing apparatus,” “computer,” or “electroniccomputer device” (or equivalent as understood by one of ordinary skillin the art) refer to data processing hardware and encompass all kinds ofapparatus, devices, and machines for processing data, including by wayof example, a programmable processor, a computer, or multiple processorsor computers. The apparatus can also be, or further include specialpurpose logic circuitry, for example, a central processing unit (CPU),an FPGA (field programmable gate array), or an ASIC(application-specific integrated circuit). In some implementations, thedata processing apparatus or special purpose logic circuitry (or acombination of the data processing apparatus or special purpose logiccircuitry) can be hardware- or software-based (or a combination of bothhardware- and software-based). The apparatus can optionally include codethat creates an execution environment for computer programs, forexample, code that constitutes processor firmware, a protocol stack, adatabase management system, an operating system, or a combination ofexecution environments. The present disclosure contemplates the use ofdata processing apparatuses with an operating system of some type, forexample LINUX, UNIX, WINDOWS, MAC OS, ANDROID, IOS, another operatingsystem, or a combination of operating systems.

A computer program, which can also be referred to or described as aprogram, software, a software application, a unit, a module, a softwaremodule, a script, code, or other component can be written in any form ofprogramming language, including compiled or interpreted languages, ordeclarative or procedural languages, and it can be deployed in any form,including, for example, as a stand-alone program, module, component, orsubroutine, for use in a computing environment. A computer program can,but need not, correspond to a file in a file system. A program can bestored in a portion of a file that holds other programs or data, forexample, one or more scripts stored in a markup language document, in asingle file dedicated to the program in question, or in multiplecoordinated files, for example, files that store one or more modules,sub-programs, or portions of code. A computer program can be deployed tobe executed on one computer or on multiple computers that are located atone site or distributed across multiple sites and interconnected by acommunication network.

While portions of the programs illustrated in the various figures can beillustrated as individual components, such as units or modules, thatimplement described features and functionality using various objects,methods, or other processes, the programs can instead include a numberof sub-units, sub-modules, third-party services, components, libraries,and other components, as appropriate. Conversely, the features andfunctionality of various components can be combined into singlecomponents, as appropriate. Thresholds used to make computationaldeterminations can be statically, dynamically, or both statically anddynamically determined.

Described methods, processes, or logic flows represent one or moreexamples of functionality consistent with the present disclosure and arenot intended to limit the disclosure to the described or illustratedimplementations, but to be accorded the widest scope consistent withdescribed principles and features. The described methods, processes, orlogic flows can be performed by one or more programmable computersexecuting one or more computer programs to perform functions byoperating on input data and generating output data. The methods,processes, or logic flows can also be performed by, and apparatus canalso be implemented as, special purpose logic circuitry, for example, aCPU, an FPGA, or an ASIC.

Computers for the execution of a computer program can be based ongeneral or special purpose microprocessors, both, or another type ofCPU. Generally, a CPU will receive instructions and data from and writeto a memory. The essential elements of a computer are a CPU, forperforming or executing instructions, and one or more memory devices forstoring instructions and data. Generally, a computer will also include,or be operatively coupled to, receive data from or transfer data to, orboth, one or more mass storage devices for storing data, for example,magnetic, magneto-optical disks, or optical disks. However, a computerneed not have such devices. Moreover, a computer can be embedded inanother device, for example, a mobile telephone, a personal digitalassistant (PDA), a mobile audio or video player, a game console, aglobal positioning system (GPS) receiver, or a portable memory storagedevice.

Non-transitory computer-readable media for storing computer programinstructions and data can include all forms of media and memory devices,magnetic devices, magneto optical disks, and optical memory device.Memory devices include semiconductor memory devices, for example, randomaccess memory (RAM), read-only memory (ROM), phase change memory (PRAM),static random access memory (SRAM), dynamic random access memory (DRAM),erasable programmable read-only memory (EPROM), electrically erasableprogrammable read-only memory (EEPROM), and flash memory devices.Magnetic devices include, for example, tape, cartridges, cassettes,internal/removable disks. Optical memory devices include, for example,digital video disc (DVD), CD-ROM, DVD+/−R, DVD-RAM, DVD-ROM, HD-DVD, andBLURAY, and other optical memory technologies. The memory can storevarious objects or data, including caches, classes, frameworks,applications, modules, backup data, jobs, web pages, web page templates,data structures, database tables, repositories storing dynamicinformation, or other appropriate information including any parameters,variables, algorithms, instructions, rules, constraints, or references.Additionally, the memory can include other appropriate data, such aslogs, policies, security or access data, or reporting files. Theprocessor and the memory can be supplemented by, or incorporated in,special purpose logic circuitry.

To provide for interaction with a user, implementations of the subjectmatter described in this specification can be implemented on a computerhaving a display device, for example, a CRT (cathode ray tube), LCD(liquid crystal display), LED (Light Emitting Diode), or plasma monitor,for displaying information to the user and a keyboard and a pointingdevice, for example, a mouse, trackball, or trackpad by which the usercan provide input to the computer. Input can also be provided to thecomputer using a touchscreen, such as a tablet computer surface withpressure sensitivity, a multi-touch screen using capacitive or electricsensing, or another type of touchscreen. Other types of devices can beused to interact with the user. For example, feedback provided to theuser can be any form of sensory feedback. Input from the user can bereceived in any form, including acoustic, speech, or tactile input. Inaddition, a computer can interact with the user by sending documents toand receiving documents from a client computing device that is used bythe user.

The term “graphical user interface,” or “GUI,” can be used in thesingular or the plural to describe one or more graphical user interfacesand each of the displays of a particular graphical user interface.Therefore, a GUI can represent any graphical user interface, includingbut not limited to, a web browser, a touch screen, or a command lineinterface (CLI) that processes information and efficiently presents theinformation results to the user. In general, a GUI can include aplurality of user interface (UI) elements, some or all associated with aweb browser, such as interactive fields, pull-down lists, and buttons.These and other UI elements can be related to or represent the functionsof the web browser.

Implementations of the subject matter described in this specificationcan be implemented in a computing system that includes a back-endcomponent, for example, as a data server, or that includes a middlewarecomponent, for example, an application server, or that includes afront-end component, for example, a client computer having a graphicaluser interface or a Web browser through which a user can interact withan implementation of the subject matter described in this specification,or any combination of one or more such back-end, middleware, orfront-end components. The components of the system can be interconnectedby any form or medium of wireline or wireless digital data communication(or a combination of data communication), for example, a communicationnetwork. Examples of communication networks include a local area network(LAN), a radio access network (RAN), a metropolitan area network (MAN),a wide area network (WAN), Worldwide Interoperability for MicrowaveAccess (WIMAX), a wireless local area network (WLAN) using, for example,802.11 a/b/g/n or 802.20 (or a combination of 802.11x and 802.20 orother protocols consistent with the present disclosure), all or aportion of the Internet, another communication network, or a combinationof communication networks. The communication network can communicatewith, for example, Internet Protocol (IP) packets, Frame Relay frames,Asynchronous Transfer Mode (ATM) cells, voice, video, data, or otherinformation between networks addresses.

The computing system can include clients and servers. A client andserver are generally remote from each other and typically interactthrough a communication network. The relationship of client and serverarises by virtue of computer programs running on the respectivecomputers and having a client-server relationship to each other.

While this specification contains many specific implementation details,these should not be construed as limitations on the scope of what can beclaimed, but rather as descriptions of features that can be specific toparticular implementations. Certain features that are described in thisspecification in the context of separate implementations can also beimplemented, in combination, in a single implementation. Conversely,various features that are described in the context of a singleimplementation can also be implemented in multiple implementations,separately, or in any sub-combination. Moreover, although previouslydescribed features can be described as acting in certain combinationsand even initially claimed as such, one or more features from a claimedcombination can, in some cases, be excised from the combination, and theclaimed combination can be directed to a sub-combination or variation ofa sub-combination.

Particular implementations of the subject matter have been described.Other implementations, alterations, and permutations of the describedimplementations are within the scope of the following claims as will beapparent to those skilled in the art. While operations are depicted inthe drawings or claims in a particular order, this should not beunderstood as requiring that such operations be performed in theparticular order shown or in sequential order, or that all illustratedoperations be performed (some operations can be considered optional), toachieve desirable results. In certain circumstances, multitasking orparallel processing (or a combination of multitasking and parallelprocessing) can be advantageous and performed as deemed appropriate.

Moreover, the separation or integration of various system modules andcomponents in the previously described implementations should not beunderstood as requiring such separation or integration in allimplementations, and it should be understood that the described programcomponents and systems can generally be integrated together in a singlesoftware product or packaged into multiple software products.

Furthermore, any claimed implementation is considered to be applicableto at least a computer-implemented method; a non-transitory,computer-readable medium storing computer-readable instructions toperform the computer-implemented method; and a computer systemcomprising a computer memory interoperably coupled with a hardwareprocessor configured to perform the computer-implemented method or theinstructions stored on the non-transitory, computer-readable medium.

1. A computer-implemented method to manage an industrial plant facility,the method comprising: monitoring multiple streams of input data from anetwork of sensors at the industrial plant facility, wherein the networkof sensors include one or more camera devices; determining, by a servercomputer, an event during construction or operation of the industrialplant facility based on analyzing the multiple streams of input data inreal-time, wherein the event is an emergency occurring inside theindustrial plant facility and in proximity to at least one operator ofthe industrial plant facility; based on the event, generating anotification to alert the at least one operator of the industrial plantfacility, wherein the notification is an alert sent to a wearable deviceworn by the at least one operator to notify the emergency; dynamicallycalculating an escape route to guide the at least one operator to safetybased on, at least in part, where the emergency is occurring at theindustrial plant facility and the multiple streams of input data fromthe network of sensors; and providing the escape route to the wearabledevice worn by the at least one operator such that the escape route isdynamically updated on the wearable device as the at least one operatorstarts to escape from the emergency and as the emergency unfolds. 2.(canceled)
 3. (canceled)
 4. (canceled)
 5. (canceled)
 6. (canceled) 7.The computer-implemented method of claim 1, wherein monitoring multiplestreams of input data from a network of sensors comprises: accessingstreams of data from at least one of: an aerial scanning at theindustrial plant facility, a mobile scanning at the industrial plantfacility, and a floor scanning at the industrial plant facility, whereinthe aerial scanning comprises: operating one or more surveillance dronesto monitor the industrial plant facility, wherein the mobile scanningcomprises: operating one or more moveable sensors to monitor theindustrial plant facility, wherein the floor scanning comprises:operating one or more fixed sensors to monitor the industrial plantfacility, and wherein at least one of the one or more surveillancedrones, the one or more moveable sensors, or the one or more fixedsensors comprise: the one or more camera devices.
 8. A computer systemcomprising: a network of sensors comprising one or more camera devices;a processor; and at least one memory, wherein at least one memorycomprise software instructions that, when executed by the processor,cause the processor perform operations to manage an industrial plantfacility, the operations comprising: monitoring multiple streams ofinput data from the network of sensors at the industrial plant facility;determining an event during construction or operation of the industrialplant facility based on analyzing the multiple streams of input data inreal-time wherein the event is an emergency occurring inside theindustrial plant facility and in proximity to at least one operator ofthe industrial plant facility; based on the event, generating anotification to alert at least one operator of the industrial plantfacility, wherein the notification is an alert sent to a wearable deviceworn by the at least one operator to notify the emergency; dynamicallycalculating an escape route to guide the at least one operator to safetybased on, at least in part, where the emergency is occurring at theindustrial plant facility and the multiple streams of input data fromthe network of sensors; and providing the escape route to the wearabledevice worn by the at least one operator such that the escape route isdynamically displayed on the wearable device as the at least oneoperator starts to escape from the emergency and as the emergencyunfolds.
 9. (canceled)
 10. (canceled)
 11. (canceled)
 12. (canceled) 13.(canceled)
 14. The computer system of claim 8, wherein monitoringmultiple streams of input data from a network of sensors comprises:accessing streams of data from at least one of: an aerial scanning atthe industrial plant facility, a mobile scanning at the industrial plantfacility, and a floor scanning at the industrial plant facility, whereinthe aerial scanning comprises: operating one or more surveillance dronesto monitor the industrial plant facility, wherein the mobile scanningcomprises: operating one or more moveable sensors to monitor theindustrial plant facility, wherein the floor scanning comprises:operating one or more fixed sensors to monitor the industrial plantfacility, and wherein at least one of the one or more surveillancedrones, the one or more moveable sensors, or the one or more fixedsensors comprise: the one or more camera devices.
 15. A non-volatilecomputer readable medium comprising software instructions, which, whenexecuted by a computer processor, cause the computer processor toperform operations to manage an industrial plant facility, theoperations comprising: monitoring multiple streams of input data from anetwork of sensors at the industrial plant facility, wherein the networkof sensors include one or more camera devices; determining an eventduring construction or operation of the industrial plant facility basedon analyzing the multiple streams of input data in real-time, whereinthe event is an emergency occurring inside the industrial plant facilityand in proximity to at least one operator of the industrial plantfacility; based on the event, generating a notification to alert atleast one operator of the industrial plant facility, wherein thenotification is an alert sent to a wearable device worn by the at leastone operator to notify the emergency; dynamically calculating an escaperoute to guide the at least one operator to safety based on, at least inpart, where the emergency is occurring at the industrial plant facilityand the multiple streams of input data from the network of sensors; andproviding the escape route to the wearable device worn by the at leastone operator such that the escape route is dynamically updated on thewearable device as the at least one operator starts to escape from theemergency and as the emergency unfolds.
 16. (canceled)
 17. (canceled)18. (canceled)
 19. (canceled)
 20. The non-volatile computer readablemedium of claim 15, wherein monitoring multiple streams of input datafrom a network of sensors comprises: accessing streams of data from atleast one of: an aerial scanning at the industrial plant facility, amobile scanning at the industrial plant facility, and a floor scanningat the industrial plant facility, wherein the aerial scanning comprises:operating one or more surveillance drones to monitor the industrialplant facility, wherein the mobile scanning comprises: operating one ormore moveable sensors to monitor the industrial plant facility, whereinthe floor scanning comprises: operating one or more fixed sensor sensorsto monitors the industrial plant facility, and wherein at least one ofthe one or more surveillance drones, the one or more moveable sensors,or the one or more fixed sensors comprise: the one or more cameradevices.